LLMs on a Shoestring: The Dynamic Cache Advantage by Arvind Sundararajan
dev.to·17h·
Discuss: DEV
💾Cache Algorithms
Semantic Dictionary Encoding
falvotech.com·12h·
Discuss: Hacker News
🗂️Type Indexing
Rowhammer: TRR on DDR5 DRAM has been broken
comsec.ethz.ch·10h·
🏷️Memory Tagging
Analog IMC Attention Mechanism For Fast And Energy-Efficient LLMs (FZJ, RWTH Aachen)
semiengineering.com·10h
🗺️Region Inference
Building High-Performance Caching in Go: A Practical Guide
dev.to·1d·
Discuss: DEV
Cache Optimization
Building a Simple Stack-Based Virtual Machine in Go
blog.phakorn.com·20h·
📚Stack Data Structures
What is Algebraic about Algebraic Effects?
interjectedfuture.com·11h
💫Effect Systems
Crashes are loud. Leaks are quiet.
blog.bitdrift.io·1d
🧠Memory Ordering
Conquering the LLM Memory Wall: How to Run 2–4x Longer Contexts with a Single Line of Code
reddit.com·15h·
Discuss: r/LocalLLaMA
🗺️Region Inference
Sound Statistical Model Checking for Probabilities and Expected Rewards (extended version)
arxiv.org·23h
⏭️Skip Lists
Topological Sort: Managing Mutable Structures in Haskell
mmhaskell.com·18h
🪢Rope Data Structures
Is Recursion in LLMs a Path to Efficiency and Quality?
pub.towardsai.net·3h
🪜Recursive Descent
A (Nearly) Branchless RESP Request Parser
kevinmontrose.com·15h
🔧Error Recovery
LAVa: Layer-wise KV Cache Eviction with Dynamic Budget Allocation
arxiv.org·23h
🗺️Region Inference
Verlog: A Multi-turn RL framework for LLM agents
blog.ml.cmu.edu·12h
🎭Erlang OTP
Linux 6.18 To Allow Rust And C Code To Use The Same Memory Model
phoronix.com·17h
🧠Memory Consistency
What Facebook's Memcache Taught Me About Systems Thinking
lorbic.com·9h·
Discuss: Hacker News
Cache-Aware Algorithms
Why You Need to Know How a Database Works Internally?
dev.to·1d·
Discuss: DEV
🗄️Database Engines
[NodeBook] Understanding Buffers in Node.js - Why they exist, where they live in memory, and how they handle binary data
thenodebook.com·20h·
Discuss: r/node
🔢Binary Formats